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A.  Statement  of  problem  studied. 

The  purpose  of  this  paper  is  to  report  some  of  our  recent  results  on  nonlinear  filtering 
which  appeared  only  in  preprint  form  [Ya].  We  have  constructed  a  new  class  of  filters 
explicitly  which  includes  both  Kalman-Bucy  filters  and  Benes  filters  as  special  cases. 

The  filtering  problem  considered  here  is  based  on  the  following  signal  observation 
model: 

f  dx(t)  =  f(x(t))dt-\-g(x(t))dv(t)  x(0)  =  xo 
t  dy(t)  =  h(x(t))dt  +  dw{t)  y(0)  =  0 

in  which  x,  r,  y  and  ti>,  are,  respectively,  R",  R^,  R"*  and  R”*  valued  processes,  and  v 
and  w  have  components  which  are  independent,  standard  Browman  process.  We  further 
assume  that  n=p,  f,k  are  smooth,  and  that  y  is  an  orthogonal  matrix.  We  will  refer 
to  z(t)  as  the  state  of  the  system  at  time  t  and  y(<)  as  the  observation  at  time  t. 

Let  />(t,  z)  denote  the  conditional  probability  density  of  the  state  given  the  observation 
{y(5);0  <  s  <  t}.  It  is  well-known  that  p(t,z)  is  jpven  by  normalizing  a  function,  <7(t,z), 
which  satisfies  the  following  Duncan-Mortensen-Zakai  equation: 


m 

(2)  da(<,  z)  =  x)dt  -1-  ^  Li<T{t^  x)dy{t)^  <y(0,  z)  =  <ro 

i=l 


where 


A  tl  «  fit 

^  f  o  Oft  1  .  2 

^dxi  2^  * 

»=i  1=1  »=i 


and  for  t  =  1, . . .  ,  m,  is  the  zero  degree  differential  operator  of  multiplication  by  hi.  <7o 

is  the  probability  density  of  the  initial  point,  Zq. 

Equation  (2)  is  a  stochastic  partial  differential  equation.  In  real  applications,  we  are 
interested  in  constructing  robust  state  estimators  from  observed  sample  paths  with  some 
property  of  robustness.  Davis  studied  this  problem  and  proposed  some  robust  algorithms. 
In  our  case,  his  basic  idea  reduces  to  defining  a  new  uxmormalized  density 


$(t,z)  =  expT-  5^hi(z)y<(oV(t,x). 

'  f=i  ' 

It  is  easy  to  show  that  ((t,  z)  satisfies  the  following  time  varying  partial  differential  equation 

(3)  §((,!)  =  Lo((t,x)  +  f;»,(i)(£o,Ije(t,*) 

»=1 

+  5  yii*)yA*)l[^o,Li]tLj]i{ttX) 


*,j=i 


^(0,z)  =  ao 


where  [Lo,Li]  denotes  the  Lie  bracket  of  Lq  and  Li. 
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Definition.  The  estimation  algebra  £  of  a  filtering  problem  (1),  is  defined  to  be  the  Lie 
algebra  generated  by  {Lq,  Lj  or  =  (Lo,  ,  •  •  •  ,  Lm)L.A. 

If  in  addition  there  exists  a  potential  function  V*  such  that  fi  =  ^  for  aU  1  <  t  <  n, 
then  the  estimation  algebra  is  called  exact. 

The  estimation  algebra  is  said  to  be  with  maximal  rank  if  x,-  +  c,  is  in  J?  for  all 
1  <  t  <  n  where  Ci  is  a  constant. 

The  problem  is  to  solve  explicitly  equation  (3).  In  particular,  we  want  to  construct 
all  possible  finite  dimensional  filters  via  Wei-Norman  approach.  This  includes  solving  the 
Brockett  problem  on  classification  of  finite  dimensional  estimation  algebras. 

B.  Summary  of  the  most  important  results. 

Recently  Tan,  Wong  and  the  present  author  [T-W-Y  1,2]  have  examined  the  properties 
of  finite  dimensional  estimation  algebras  and  the  Wei-Norman  approach  in  detail.  There 
a  class  of  filtering  systems  having  the  property  that  the  drift-term  /  of  the  state  evolution 
equation  is  a  gradient  vector  field  was  considered.  In  [Wo  2],  the  concept  of  Cl  is  introduced, 
which  is  defined  as  the  n  x  n  matrix  whose  (t,  j)-entry  is  In  view  of  Poincare 

lemma,  /  is  a  gradient  vector  field  if  and  only  if  =  0.  b  jYal,^],  we  consider  a  more 
general  class  of  filtering  systems  having  the  property  that  are  constants  for  all 

t,  j  i.e.  fl  is  a  skew  symmetric  constant  matrix. 

Theorem  1.  are  constants  for  all  t  and  j  if  and  only  if  (/i, . . .  ,/«)  = 

(^1, . . .  ,£n)  +  •  •  •  >  where  are  polynomials  of  degree  one  and  9  is  a 

C®®  function. 

Notice  that  in  the  statement  of  Theorem  1,  if  ^  s  0  on  R**,  then  we  are  in  the  situation 
of  the  Kalman-Buchy  filtering  system;  while  if  (^1, . . .  ,^„)  =  0,  then  we  have  the  Bene’s 
filtering  system  as  special  case. 

Define 


and 


Theorem  2.  Let  E  be  a  finite  dimensional  estimation  algebra  of  (1)  satisfying  ^  = 
Cij  where  Cij  are  constant  for  all  1  <  t,  j  <  n.  then  hi,...htn  are  polynomials  of  degree  at 
most  one. 


Theorem  3.  Let  F(xi , . . .  ,  Xr)  be  a  C®®  function  on  R”.  Suppose  that  there  exists  a  path 
C  :  R  — ♦  R"  and  ^  >  0  such  that  hm  ||C(t)||  =  c»  and  ^lim  ^  where 

Bf{C(t))  s=  {x  €  R"  :  ||x  —  C(<)||  <  tf}.  then  there  are  no  C®®  functions  /i,/2,  •  •  •  ,/n  on 
R**  satisfying  the  equation 


=  F. 
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Corollary.  Let  F{xi,. ..  ,  Xn)  be  a  polynomial  on  R”.  Suppose  that  there  exists  a  poly¬ 
nomial  path  C  :  R  — »  R"  such  that  lim  ||C(f)l|  =  oo  and  lim  F  o  C(t)  =  — oo.  Then 

1*^00  !■  *oo 

there  is  no  C**  functions  /j', /2, . .  •  , /n  on  R"  satisfying  the  equation 


Definition.  Let  E  be  an  estimation  algebra  of  (1)  satisfying  =  Cj^  where  Cij 

are  constants  for  all  1  <  t,  j  <n.  If  E  is  finite  dimensional,  then  the  matrix 

ir  =  IV/i„Vh2,...,Vh«l 

is  a  constant  matrix  in  view  of  Theorem  2.  H  is  called  the  observation  matrix  of  (1). 

The  following  result  provides  a  simple  characterization  of  when  the  dimension  of  an 
estimation  algebra  is  finite  dimenrional. 

Theorem  4.  Let  E  be  an  estimation  algebra  of  (1)  satisfying  =  Cij  where  Cij 

are  constants  for  all  1  <  i,  j  <  n. 

(i)  if  q  is  a  polynonual  of  degree  at  most  two,  then  E  is  finite  dimensional  and  has  a  basis 
consisting  of  =  Xg,  difierential  operators  Ei, . . .  ,Ep  (for  some  p)  of  the  form 

n 

oyDi + Pi 

where  Ojj’s  are  constants  and  Pi*8  are  affine  in  x,  and  zero  degree  differential  operators 
Ep+i , . . .  ,  Eg,  1  (form  some  q>  p)  where  E.-’s  are  affine  in  x  for  p+1  <i  <q.  Moreover 

m 

the  quadratic  part  of  q  —  ^  is  positive  semi-definite. 

tsl 

(ii)  Conversely  if  E  is  finite  dimensional,  then  , . . . ,  are  affine  in  x  i.e.  the  observation 

matrix  is  a  constant  matrix.  fVirthennme  if  the  observation  matrix  has  rank  n  (in 
particular  m  >  n),  then  q  is  a  polynomial  of  degree  at  most  two. 

Theorem  5.  Let  E  be  an  estimation  algebra  of  (1)  satisfying  “  7  f where  Cy 

are  constants  for  all  1  <  t,  j  <  n.  Suppose  m  >  n  and  the  observation  matrix  is  a  constant 
matrix  with  full  rank.  If  E  is  finite  dimensimial,  then  it  is  of  dimension  2n  -I-  2  with  basis 
given  by  1,  xi,...  ,Xn,  Di,...  ,Dn  and  Lq. 

Finally  the  following  theorem  describes  the  finite  dimensional  filters  explicitly. 

Theorem  6.  Let  E  be  an  estimation  algebra  of  (1)  satisfying  ^  =  Cij  where  Cij 

^  n 

are  constants  for  all  1  <  i,  j  <  n.  Suppose  E  is  fimte  dimenrional,  then  q  =  E  + 

n 

E  +  d  where  a,y,  hi  and  d  are  constants  for  all  1  <  t,  j  <  n  and  the  observation 
matrix  is  a  constant  matrix.  Supp<Me  further  that  m  >  n  and  the  observation  matnx  has 


3 


full  rank.  Then  the  robust  Duncan-Mortensen-Zakai  eqtiation  (3)  has  a  solution  for  all 
t  >  0  of  the  form: 


where  r(f),  ri(t), . . .  ,  r„(f),  ai(l), . . . ,  Sn(t)  satisfy  the  following  ordinary  differential  equa¬ 
tion  (5),  (6)  and  (7).  For  1  <  »  <  n 

(®)  ~  ^  +  52  ^**y*(0 

1*1  **i 


where  h*(<)  =  -f-  e*,  for  1  <  k  <  m;  hkj  and  c*  are  constants. 

i=i 

For  1  <  i  <  n 


(6) 

and 

(7) 


isl 

t=l  t*l  'jf*!  ^ 

+  V  «<(f)Sjk(f)fy'CyC,k-fioj*') 

-  ^  5.(t)s>(t)c<>  + 52  *“<(<) 

•,/=l  1=1 

- 12  «j(0co  S 


i*2  i*! 
m 


«  ra 

+  o  12  vi(<)yj(<)52^'**'*- 


2  , 
l,J*l 


ft*l 


The  proofs  of  these  theorems  are  presented  in  [Ya3]. 

Let  n  be  the  dimension  of  the  state  space.  It  turns  out  that  all  finite  dim«>nBWTnil 
estimation  algebras  with  nontrivial  observation  are  automatically  exact  with  mAYimnl  rank 
if  n  =5  1.  We  are  able  to  clasafy  all  finite  dimennonal  estimation  algebras  with  Tn«Y^m»1 
rank  if  the  dimension  of  the  state  space  is  at  most  two.  Theorem  8  below  is  the  most 
important  step  towards  the  complete  solution  of  the  famous  Brockett  problem.  The  major 
difference  between  our  Theorem  7  and  the  corresponding  theorem  in  Tam- Wong- Yau  [T- 
W-Y  1,2]  is  that  we  are  able  to  remove  the  exactness  assumption  in  th«r  Theorem.  The 
novelty  of  the  problem  is  that  there  is  no  assumption  on  the  drift  term  of  the  nmiHno^r 
filtering  system.  However,  in  the  course  of  this  proof  of  Theorem  8,  we  show  that  the  drift 
term  cannot  be  very  arbitrary  if  the  estimation  algebra  is  finite  dimensional.  In  fact  we 
sIkiw  that  the  drift  term  must  be  linear  vector  field  plus  gradient  vector  field. 
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Theorem  7.  Suppose  that  the  state  space  of  the  filtering  system  (1)  is  of  dimenrion  one. 
K  the  estimation  algebra  E  is  finite  dimensional,  then  either 

(i)  .E  is  a  real  vector  space  of  dimension  4  with  basis  given  by  1,  x,  J7  :=  ^ —  /  and 

Lo  =  -  v)  or 

(ii)  E  is  a  real  vector  space  of  dimension  2  with  basis  pven  by  1  and  Lq  =  t})  or 

(iii)  E  is  a  real  vector  space  of  dimension  1  with  basis  pven  by  Lo  =  —  tf). 

Theorem  8.  Suppose  that  the  state  space  of  the  filtering  system  (1)  is  of  dimension  two. 
If  E  is  the  finite  dimensional  estimation  algebra  E  with  maximal  rank,  then  E  is  a  real 
Lie  algebra  of  dimenrion  6  with  basis  given  by  1,  xi,  xs,  Ei,  D2  and  Lq. 

The  complete  proof  of  this  theorem  is  in  [Ch-Ya]. 

It  is  quite  easy  for  people  to  think  that  the  Wei-Norman  approach  is  a  way  to  solve 
P.D.E.  (3)  by  means  of  O.D.E.  This  is  not  exactly  the  case.  As  it  was  shown  for  example 
in  Theorem  6  that  the  robust  Duncan-Mortensen-Zakai  equation  (3)  has  a  solution  for  all 
t  >  0  of  the  form 

where  Ei  =  =  /<  and  T(t),  ri(t), . . .  ,r„(f),  Si(f), . . .  ,Sn(<)  satisfy  a  certain  system  of 

ordinary  differential  equations.  However  one  still  has  to  write  down  e*^®<To  explicitly.  This 
means  that  one  has  to  solve  the  so-called  Kolmogorov  equation.  In  what  follows  we  shall 
outline  the  scheme  on  how  to  solve  the  Kolmogorov  equation  explicitly.  The  full  details 
can  be  found  in  [Ya-Yal,2].  In  fact,  rising  the  rimilar  technique  introduced  here,  one  can 
actually  solve  some  special  class  of  Duncan-Mortensen-Zakai  equation  (2). 


Formal  solution  to  Kolmogorov  equation. 

Lenuna  9.  Equation  (3)  is  equivalent  to  the  following  equation 


(8) 


'•«!  *  •«!  »sl  ' 


u(0,x)  =  ao(x). 


Theorem  10.  The  equation  (3)  has  a  formal  asymptotic  solution  on  R**  if  hi{x)  are 
constants  for  all  1  <  t  <  m.  In  fact,  the  solution  is  of  the  following  form 

(9)  00  00 
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oo 

where  •  Here  ak(xy()  are  described  explicitly  as  follows.  Let 


iksQ 


(10) 


(^,0  =  f  E(®.  -mi( + <(*  -  o)dt 


Then 

(U)  «o(*,{)  =  «•<*■*>■ 

Suppose  that  aA-.i(x,()  is  given.  Let 

(12) 

=  5 1  - 1  -  \  (t 

Then,  for  lb  >  1 

(13)  «(*,«  =  «•(•■<>  + 

Jo 

Theorem  11.  The  equation  (3)  has  a  formal  solution  on  R"  if  hi(x)  are  constants  for  all 
1  <  t  <  m.  In  fact  the  solution  is  of  the  following  form 

(14)  «(i,x)  =  «p(-i  -  w)'+ 

i:p  xi  -  yi)/t(v  +  <(*  -  •  [i  + 

+ . . .  +  a*(x,  y)t*  + . . . ]<ro(y)dyi, .  • . , dyn 

where  Ok(x,y)  =  /  t*'~'y*(y  +  <(x  -  y)^y)dt  and 
Jo 

».(*,»)= 5  E  »> + E  »> 

•»!  •  t*l  '  '  I»1 
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Theorem  12.  For  <  <  ^  so  that 


1  ^  1 
4JVt*  +  nCt  <  g  and  nC  <  ^ 


axe  satisfied,  the  following  series  converges. 

tf)  +  £  (-1)"*+^  /mT2  /«+!  Lj  'Lx 

fro 

and  it  represents  a  kernel  ^(t,x,y)  which  satisfies 

lim^(<,x,y)  =  ^*(y)- 

t— .0 

T  f  4r  have  found  an  expUdt  kernel  for  the  equation.  When  time  is 

fi-aThe  up  to  W  T  by^the  fonnul. 

♦(T,»,v)=/  J -I 

J*7  •'**  ^ 

Here  K  is  the  smallest  integer  greater  than 

Corollary  13.  The  (uudamoutal  solution  «t,  l,  y)  io  Theorem  12  is  approximated  by 

tnsO 

which  is  readily  computable.  Here 

The  error  for  such  an  approximation  is  given  by 


^  (-1)"*+Vm(<,x,y) 

maaK+l 


which  can  be  estimated  hy 


(1  +  +  V?|y0’''«tp((*  -  V)-  /(*)  +  “p(-® 

^+»n+l 


which  dearly  tends  to  zero  rapidly  if  i  is  small  and  K  is  large. 
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